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Abstract We made heat-capacity measurements of two dimensional (2D) "^He ad- 
^ ' sorbed on graphite preplated with monolayer "^He in a wide temperature range (0.1 

, < T < 80 mK) at densities higher than that for the 4/7 phase ( = 6.8 nm~^). In the 

density range of 6.8 < p < 8.1 nm"'^, the 4/7 phase is stable against additional '^He 
atoms up to 20% and they are promoted into the third layer. We found evidence that 
■ such promoted atoms form a self-bound 2D Fermi liquid with an approximate density 

of 1 nm~^ from the measured density dependence of the 7-coefRcient of heat capacity. 
We also show evidence for the first-order transition between the commensurate 4/7 
' O ' phase and the ferromagnetic incommensurate phase in the second layer in the density 

^! range of 8.1 < p < 9.5 nm"2. 

O . Keywords quantum fluid ■ quantum solid • two dimensional system • helium-3 
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1/^ ' Monolayer He adsorbed on a graphite substrate is an ideal model system for studies 

of strongly interacting two-dimensional (2D) Fermions. In this system, we can vary 
areal density of Fermions over a wide range where various quantum phases are found 
^\ ^ [nil]- Especially, in the second layer, a commensurate (C) solid phase, "the so called 

' 4/7 phase", appears at the four sevenths density of that of the first layer [2], where the 

multiple spin exchange (MSE) interactions compete each other yielding strong mag- 
netic frustration. It is believed that the magnetic ground state of this phase is the 
' gapless quantum spin-liquid (QSL) [3l|4]. According to the first principles calculations 

^ , based on the WKB approximation [3, the three-particle ring exchange becomes dom- 

inant with increasing density due to its less steric hindrance than the other exchange 
processes. Therefore, the magnetic ground state changes from the gapless QSL state to 
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the frustrated ferromagnetic (FF) one with increasing density as was observed in the 
previous magnetization measurements in low fields [6l[7]- Schiffer et al. [6] claimed the 
first-order transition between the two phases from the measured linear density depen- 
dence of T = magnetization for the pure ^He system (hereafter, '^He/^He/gr). The 
neutron scattering experiment (8j shows that, at high enough densities, the structure 
of the second layer is the incommensurate (IC) solid with a triangular lattice. How- 
ever, the nature of the magnetic and structural transitions among those phases are not 
known in detail until now. 

In this letter, we present results of heat-capacity measurements of 2D '^He adsorbed 
on graphite preplated with monolayer "^He (hereafter, '^He/^He/gr) in a wide tempera- 
ture range (0.1 < T < 80 mK) at higher densities beyond the 4/7 phase (p > P4/7 = 6.8 
nm^^). The results show clearly how the QSL-FF transition evolves as a function of 
increasing density. 



2 Experimental 

The surface area (A) of Grafoil (exfoliated graphite) substrate used here is 556 m^. 
The first layer ^He of 12.09 nm^^ was prepared at T = 4.2 K, and then '^He overlayers 
were made at 2.7 K. We assume almost complete isotropic stratification between the 
first and second layers. 

The heat-capacity was measured with the relaxation method at 0.1 < T < 1 mK 
and the adiabatic heat-pulse one at T > 0.3 mK. The temperature of the samples 
was determined by a platinum-pulsed NMR thermometer (T < 30 mK), and a carbon 
resistance one (T > 20 mK) which are calibrated by a ^He melting curve thermometer. 
Details of the experimental setup were described in the previous paper [5]. 
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Fig. 1 (Color online) Heat capacities (C) of 2D '^He on graphite at four representative densities 
involving the commensurate 4/7 phase (p = 6.79 and 7.96 nm~^), the C-IC coexistence region 
(8.82 nm~^), and the high density bound of the coexistence region (9.50 nm~^) for the second 
layer. 
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Fig. 2 (Color online) Isotherms of C at several temperatures. The vertical lines at p = 6.8 
nm~^ correspond to the 4/7 phase, and lines at p = 8.1 and 9.5 nm~^ are the low and high 
density bounds of the C-IC coexistence region. 



3 Results and Discussion 

Fig.[T]shows the measured heat capacities (C) at four representative densities. The data 
can be classified into two distinct density regions. We discuss each region separately in 
the foUowings. 

It is known that, in ^He/^He/gr, the 4/7 phase (P4/7 = 6.4 nm~^) has two broad 
C peaks at 1.8 and 0.3 mK, which is characteristic of highly frustrated magnetic sys- 
tems |3]. For the present system (^He/^He/gr), we also observed a similar double-peak 
structure in the 4/7 phase but at somewhat lower temperatures, i.e., 1.2 and around 
0.2 mK (see Fig. 1). The peak-temperature differences are presumably caused by the 
different densities of the 4/7 phase with respect to the first layer ones. 

With increasing density, the peak temperatures are unchanged until 8.1±0.1 nm~^, 
while the high-T heat capacities increase progressively. This can be seen more clearly 
in Fig. [2] where C isotherms at several fixed temperatures are shown. Excess heat 
capacities, Cpi^ = C(p)~C(p^p), can nicely be represented by the following functional 
form: 

CFL = 7r-«r2, (1) 

which is characteristic of degenerate Fermi fluid. In 2D systems, 7 = nk'^m* A/ (Sti^) , 
and 7 depends only on the ^He effective mass m* and A. Therefore, we conclude that 
the 4/7 phase is stable up to p « 8.1 nm~^ and the additional atoms are promoted 
into the third layer forming a degenerate 2D Fermi fiuid in the temperature range we 
studied. 
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The 7-coefficients obtained in this way at densities below 10.3 nm~^ are plotted 
as a function of the excess density (p — P4/7) in Fig. 3. The most striking feature 
here is that the 7 values are smaller than that for the ideal Fermi gas spreading over 
the whole surface (70) with m* jm = 1. Moreover, 7 increases linearly with p in the 
density region of 7.2 < p < 8.1 nm~^ and approaches 70 near 8.1 nm~^. This indicates 
that the third-layer fluid forms a self-bound 2D Fermi liquid (or puddle) with a fixed 
density around 1.3 nm~^ covering a limited area of the surface. The puddles cover the 
whole surface at p ~ 8.1 nm~^ where the two phase coexistence between the C and IC 
solids starts (see below). Although similarly small 7 values were noticed in the previous 
heat capacity measurements in ^He/'^He/gr [Til 10], they were considered as substrate 
heterogeneity effects not the puddle formation presumably because of the lack of data 
of the detailed density variations. Also, the present observation is different from the 
previous suggestion by Godfrin et al. [11] who assumed the puddle formation of about 
4 nm~^ at much higher densities than we observed. 

It has been believed that the critical point does not exist, i.e., the absence of the 
gas-liquid transition, in 2D '^He both theoretically [iT and experimentally IT. However, 
the variational Monte Carlo calculation taking account of delocalization of the wave 
function perpendicular to the 2D plane [13) suggests the gas-liquid coexistence below 
about 2 nm~^. It seems to be plausible that the third-layer ^He on graphite can be 
self-bound due to the much smaller confinement potential than in the first- and second- 
layers. 

Within a small excess-density regime below 0.5 nm~^, the linear density dependence 
of 7 does not seem to hold (Fig. 3) . The most plausible explanation for this is that the 
first 7% excess particles are somehow accommodated in the second layer and possibly 
in the third layer as well extending the area of the 4/7 phase. This explanation is 
consistent with small increases of the 0.5 and 1 mK isotherms in the corresponding 
density region (see Fig. 2). If this is the case, the self-bound density should be about 1.0 
rather than 1.3 nm~^. We don't know, at present, how the particles are accommodated 
in the commensurate 4/7 phase; compressing with domain walls? or filling intrinsically 
existing vacancies? 

In Fig. 3 we also plotted the 7 values at higher densities than 8.1 nm~^. Here we 
fitted the raw C data to the fitting function described below which is slightly different 
from eq. (1). One can see a clear kink at 8.1 ± 0.1 nm~^, and the high density behavior 
seems to approach 70 at zero excess density. This is a further support for the present 
scenario since the slow increase of 7 above 8.1 nm~^ should be due to increasing m* , 
in the uniform 2D fluid. Note that, in general, a commensurate phase (the 4/7 phase) 
can coexist only with a puddle phase not with a compressible fluid where the chemical 
potential varies with density. 

Above 8.1 nm~^, the temperature dependence of C dramatically changes. The 1 
mK peak height rapidly decreases, while a new peak develops rapidly near 3 mK. 
This is clearly seen in Fig. 4 where the CpL terms have already been subtracted. We 
believe that this change is due to the magnetic QSL-FF transition associated with the 
structural C-IC transition within the second layer and that the 3 mK peak corresponds 
to the FF IC phase [14] from our previous magnetization measurements [15]. We fitted 
the data in this region to the following equation expected from the simple coexistence 
model: 



C = {1 ~ x)Cc + xCic + Cfl, 



(2) 
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Fig. 3 The 7-coefficient versus excess density from the 4/7 phase (P4/7 = 6.8 nm~^). The 
vertical Una is the boundary between the commensurate region and two-phase coexistence 
region. The horizontal line corresponds to the 7 value of an ideal 2D Fermi gas (m* /m = 1) 
for A = 556 m^. The lines though the data points are guides to the eye. 



where Cq and C\q are smoothed heat-capacities measured at p = 7.96 (C) and 9.50 
nm~^ (IC) without the Fermi fluid contributions CpLi respectively, x is the areal ratio 
of the IC to C sohds in the second layer. The fittings are in good agreement with 
the experimental data as shown in Fig. 4, and x increases linearly with increasing p 
(see the inset). In addtion, all the data cross each other roughly at a single point (1.6 
mK, 8.6 mJ/K) as expected. Thus, the present results show unambiguously the first 
order transition between the gapless QSL (C phase) and the FF state (IC phase) in 
the density region between 8.1 and 9.5 nm~^. 

The high-density bound of the coexistence (~ 9.5 nm~^) is determined as a density 
above which the 3 mK peak starts to shift to lower temperatures. This can be seen as a 
slope change at the corresponding density in the C isotherm at 0.5 mK in Fig. 2. The 
shift is caused by lateral compression of the IC solid [14] . We note that the fittings to Eq. 
(2) give systematically larger heat capacities below 1 mK for the intermediate densities. 
Particularly at 8.21 nm~^, the fitting quality is worse, for which we don't know the 
reason now. Since low temperature magnetic properties of the 4/7 phase should be very 
sensitive even to small changes in competing interactions [2], the discrepancy might be 
due to a possible interlayer interaction between the third-layer fiuid and the underlying 
4/7 phase or to a domain wall structure in the C-IC transition. 



4 Conclusion 

From the heat capacity measurements down to 0.1 mK, we found that the commen- 
surate 4/7 phase in the second layer on graphite is stable against additional particles 
up to 20% which are promoted into the third layer forming the low-density puddles of 
about 1 nm^^. We also obtained clear evidence for the first-order transition between 
the 4/7 phase with the gapless QSL ground state and the ferromagnetic incommensu- 
rate phase. 
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Fig. 4 (Color online) Heat capacities of the second layer solid '^He on graphite in the C-IC 
coexistence region. The solid lines are fittings to eq. (2) with x = 0, 0.17, 0.63, 0.83, and 1 
where x is the fraction of the IC solid. Note that the fluid overlayer contributions Cfl are 
already subtracted here. The inset shows the density variation of x. 
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